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(57) Abstract 

A dynamically upgradeable disk array chassis (10) and method for dynamically upgrading f^ata storage syst^^^ 
upgradeable disk ar^y chassis (10) includes a serial bus having a first bus (22) and a second bus (24) A ^^unt (40) coi^n«^ m^^^ 

separating the communication path and serial path signals. 
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DYN AMICALLY UPGRADEABIX DISK ARRAY SYSI^ AND MFTHOD 

Tp/-hnical Field 

This invention relates to dynamically adding a disk array chassis to an already 
5 operating disk drive array, and communicating with the new disk array chassis over a 
communication path before the disk drives are interfaced on a high speed path w.th the 

disk drive controller. 

Rackgroiind of the I nvention 
subsystems comprising disk arrays, i.e.. groups of small, independent disk drive 
,0 modules used to store large quantities of data have been developed and found to possess 
n»any advantages over a single large disk drive. For example, the individual modules of a 
disk array typically take up very litUe space and typically use less power and cost less than 
a single large disk drive, yet. when grouped together in an array, provide the same data 
storage capacity as a single large disk drive. In addition, the small disks of an array 
15 retrieve data more quickly than does a single large disk drive because, with a small d.sk 
drive, there is less distance for the actuator to travel and less data per individual disk to 
search through. The greatest advantage to small disk drives, however, is the boost they 
give to I/O performance when configured as a disk array subsystem. 

A disk array is typically housed in a chassis, which may be an enclosure, for 
.() holding a plurality of disk ilnves. When addiuonal memory .storage space is required, it is 
desirable to be able to add an addiUonal disk array chassis to the existing system. It ts 
further desirable that one be able to add the new disk array chassis to the existing system 
without needing to shut down the existing system. In other words, it is desirable to 
provide a dynamically upgradeable disk array system. 
25 Fo/ a system including a disk-controller communicating over a loop with a 

~ ' plurality of disks, it is undesirable to expand that bus by simply atiding more disk drives. 
n,ei^ may be a malfunction in any of the new disk drives. Further there may be a 
-problem with the new connection to ihe existing loop. WhUe the functional sutus of the 
new equipment can be tested by the disk controller after it is connected to the loop, rf 
30 there is a malfunction, the er^tire loop (and disk drives) will be degraded and may be 
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rendered inoperable or inaccessible. Therefore, it is desirable to be able to determine the 
integrity of the new disk drives and bus before permitting interface with the existing 
system. 

Summary of the Invention 
5 In accordance with an embodiment of the present invention, a dynamically 

upgradeable disk array chassis includes a chassis that contains the disk drives. The disk 
drives and a disk controller are connected in a loop with a first serial bus for transmitting 
data from the controller and a second serial bus for passing data back to the controller. 
The disk drives are connected to one or the other of the serial busses. A shunt is 
K) connected to the first and second busses at the end opposite the controller and has a 
normal state in which the first bus is connected to the second bus thus completing the 
loop. The shunt may also assume a state in which each of the first and second serial 
busses are connected to separate outputs. The separate outputs are used to connect to a 
new disk array chassis with similar bussies and shunting device. Each chassis has an 
15 environmental monitor that controls the state of its shunt. A separate serial 

communication bus connects to the monitor. When a new disk array chassis is connected 
to the existing.chassis, the existing. chassis's environmental monitor may communicate 
• through its serial communication bus with the serial communication bus and 
' environmental monitor on the new disk array chassis to determine whether conditions are 
20 suitable for extending the disk drive loop to include the disks on the new disk array 
• chassis. If no faults are detected,. the existing chassis's environmental monitor switches 
its shunt to connect the disk drive serial busses of the existing disk array chassis to those 
of the new disk array chassis. The new chassis's environmental monitor leaves its shunt 
■' in the normal state to connect the two disk drive busses and the disk drive loop is again 
25 complete. , . 

In:accordance;with an embodiment of the invention, diplexing is used to provide 
the path for the serial communication bus to the environmental monitor, and the signals 
for the disk drive loop over the same wires of a single cable connecting the disk array 
chassis to one another. Preferably,..low frequency signals are used for the communication 
30 v^ith the environmental, monitor and high, frequency signals are used for disk drive loop 
communications including I/O operations. The low frequency signals riiay be similar to 
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those of the RS-232 serial data protocol and the high frequency signals may adopt the 
Fibre Channel Arbitrated Loop signal protocol. The Fibre Channel 8B/10B signal 
encoding advantageously guarantees frequent transitions on the Fibre Channel signal so 
that the signal car> always be distinguished from the low frequency signals. The Fibre 
5 Channel encoding keeps the frequency content of the Fibre Channel signal isolated to 100 
MHZ and above by guaranteeing a transition at least every 5 bits. 

A diplexer is connected to the environmental monitor serial communication bus 
and the separate disk drive serial bus outputs of the shunt for combining the high 
frequency data signals from the disk drive controller and the low frequency data signals 
,0 from U.e environmental mon.tor serial communication bus which are to be sem out from 
the chassis. The diplexer also includes a configuration for separaung the high frequency 
disk drive serial bus data signals from the low frequency environmental mon.tor SC8 data 
signals coming in from the new disk array chassis. By providing a single connector and 
diplexing and shunt control in the presently preferred embodiment for both the low and 
15 high frequency communication signals, the integrity of the new chassis may be _ 

determined over the low frequency environmental monitor communication path wrthout 
' ■ electrically connecting the high frequency paih and possibly disrupung operation on the 
exisung disk array systeni. Only after the integrity of the connection and the pperab.hty 
of the new disk array enc.osure'is defermined will the existing chassis.shum bcswrtched 
■ 20 into the state permitting connection or th. high trequency data path with the disk drives o. 

the new disk array chassis. 

Referring now more particularly to the multiplexing of the two signals.it is noted 
" that a common Fibre Chamiel (FC) data communications link may be used. In preferred 

embodiments of the invention, the first signal to be diplexed is a low frequency 
25 ■ asynchronous or synchron6us RS-232 type serial signal; and the' second signal ts the 
standard hieh frequency Fibre Channel signal. The terms "low frequency" and "h.gh , 
frequency" are used herein as relative to bhe anotHer: As used herein, a low frequency 
signal is one that can be separated-by filtering from the high frequency signal and vrce 
versa. The low frequency signal, which in preferred embodiments is used to communicate 
30 between environmental monitor U ARTS, is ^extremely slow in comparison to the Fibre 
Channel sianal. This signal, preferably transmitted at 9600:baud..has a maximum _ 
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fundamental frequency of 4.8 kHz, and a minimum frequency of DC. The square wave 
nature of this signal will normally have higher order harmonics which extend to very high 
frequencies. Consequently, in preferred embodiments of the invention, these harmonics 
may be limited by low pass filtering without affecting the information content of the 

5 signal, with the intended result of isolating the RS-232 type signal to a low frequency 
band from DC to about 100 kHz. The high frequency FC signal is limited to 100 MHZ, 
and beyond by the aforementioned 8B/10B encoding. 

In an embodiment of the present invention, the high frequency Fibre Channel, and 
the low frequency RS-232 type signal, are frequency division multiplexed into a 

10 composite signal which is sent over a single cable. The cable will preferably be a twinax 
Fibre Channel arbitrated loop standard configuration having two conductor pairs (1 pair 
for each direction) contained within a common shield. Isolation between the two 
conductor pairs is maintained by locating the two pairs orthogonally in the cable. Each 
pair will contain a FC signal in differential mode, and a RS-232 signal in common mode. 

15 In each conductor pair, one wire conducts a sum of the high frequency FC signal and the 
. low frequency RS-232 type signal and the other wire conducts the difference resulting 
when the high frequency FC signal is subtracted from the low frequency RS-232 type 
signal. .• ■ ■ w ■ 

20 r. Brief Description of the Drawings 

V The invention may be more readily understood by reference to the following 
detailed description, taken with the accompanying drawings, in which: 

FIG. 1 is a block diagram of a chain of dynamically upgradeabie disk array chassis 
of the present invention. . . . , . 
25 ' FIG. 2 is a flow chart of an.upgrading algorithm for use with the present invention. 
. . FIG. 3 is a block diagram of a system of interconnected disk array chassis. 

FIG. 4 is a block .diagram of an environmental monitor for use in the disk array 

chassis of FIG. L , . . 

FIG. 5 is a graph showing the ^diplex filter frequency response. 
30 . FIG. 6 is a figure showing the composite Fibre Channel and RS-232 type signals. 

FIG. 7 is a circuit diagram for the differential coupling circuit. 
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FIG. 8 is a circuit diagram showing the common mode coupling circuit. 
FIG. 9 is a functional diagram showing an embodiment of the invention using 
twin-ax or twisted-pair cable and common mode coupling. 

FIG. 10 shows an implementation of the FIG. 9 circuit diagram implemented using 

5 transformers. 

FIG- 1 1 is a schematic circuit diagram of the low frequency signal input and output 
portions of a diplexer for use in the disk array chassis of FIG. 1. 

FIG. 12 is a schematic circuit diagram of the high frequency signal input portion of 
a diplexer for use in the disk array chassis of FIG. 1 . 
10 FIG. 13 is a schemauc circuit diagram of the high frequency signal output portion, 

a shunt and an expansion connector for use in the disk array chassis of FIG. 1 . 

Detailed Description of the Prefer reti Embodiments 
Referring now to the drawings, a disk teay chassis 10 is shown in block diagram 
15 form in FIG. 1. The disk array chassis provides a series of openings into which disk - 
drives 12 may be inserted. The chassis 10 of FIG. 1 is shown capable of housing a 
specified number of disk drives 12/for example ten. The mechanical chassis* may be an 
' open or closed housing or enciosui-e. Inside the chassis are conventional auxiliary 
equipment 14 including cooling fans, power supplies and a display card . The display 
20 card controls a display on the outside of the housing which may be used to exhibit certain 
status conditions. Status* conditions are detemined" by the environmental monitor. 

The disk drives are interconnected by a high speed serial dat^ communication path. 
In accordance with 'the presenUy preferred embodiment, the communication path is a loop 
including a first serial bus 22 directing data" in one direction and a second serial bus 24 
25 directing data in a second opposite direction. The preferred data loop is a Fibre Channel 
arbitrated loop.^ A series of pen bypass circuits 26^ are* inserted along the loop for making 
the connection with the disk drives 12! Eafch port "bypass circuit 26" is controlled by an 
environmental monitor 30. The conti-ol line between the environmental monitor 30 and 
the port bypass circuit 26 exists, but is not shown in HG. 1 . When the port bypass circuit 
30 is in its bypassed condition, its associated 'disk drive is shunted out of the loop. The 
environmental monitor 30 switches the port bypass' circuit 26 into a non-bypassed 
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condition so that signals on the serial bus are directed to and from the associated disk 
drive. In order to provide a high availability system, the disk array chassis of the presenUy 
preferred embodiment may include two high speed data communication loops and 
environmental monitors acting redundantly. Each loop is connected ultimately to a disk 
5 conu-oller 16. The two disk control processors 16, one for each loop, further serve to 
provide high availability of the data storage system. 

It is desirable that the disk array chassis permit dynamic upgrading. In that regard, 
a shunt 40 is provided along the Fibre Channel loop. In the presently preferred 
embodiment, the shunt 40 may be a port bypass circuit. The first serial bus 22 providing 
10 data in a first direction is connected to the shunt and the second serial bus 24 providing 
data in the opposite direction is also connected to the shunt. When the shunt is in its 
normally bypassed condition, the Fibre Channel loop ends at the shunt and data passes 
direcUy from the first serial bus 22 through the shunt to the second serial bus 24. When 
the shunt is switched into a non-bypassed state, die first bus 22 is allowed to pass to an 
15 expansion connection 52 and the second bus is connected to an incoming signal from the 
expansion connecuon. This extends die Fibre Channel loop into the next chassis. 

The shunt is controlled by the environmental monitor 30. The environmental 
. monitor 30 is provided \yith a serial communication pith 42 that can lead to an adjacent 
disk array chassis. The environmental monitor is a' supplier of status signals and other 
20 environmental information. The monitor may be any entity that sequences the status 
signals onto the serial communication path 42. The environmental monitors of the 
presently preferred embodiment are provided with two universal asynchronous receiver 
transmitters 44 (UART) for communicating widi a chassis connected at eidier end of the 
chassis housing the monitor. While the communicauon path 42 may be provided for 
25 connection to an adjoining disk array chassis separate from the Fibre Channel loop, in 
accorclance'with the presently preferred embddirhent of the invention, the communication 
path 42 is provided as a padi for low frequency signals which are diplexed with the high 
frequency Fibre Channel signals for transmission over a single cable 1 8. Preferably a 
,twinax cable 18 is used. This is a standard cable for Fibre Channel. The present 
30 invention advantageously adds a low frequency signkl to the high frequency Fibre 
Channel signals normally carried by the cable, % twinax cable 18 includes four wire 



SUBSTITUTE SHEET (RULE 26) 



PCT/US97/17432 

WO 98/21660 

-7- ■ 



conductors, each divided into two pairs. Each pair transports signals in a single direction 
so one pair is used for the exiting signals and the other pair of wires in the twinax cable 18 

is used for the returning signals. 

A diplexer 50 is preferably connected to transmit and receive the low frequency 
5 signals from the environmental monitor 30 and also to transmit and receive high 

frequency signals from the shunt 40. The other end of the diplexer is connected to a cable 
connector 52. Regardless of the state of the shum, communications between disk array 
chassis environmental monitors are possible over the single twinax cable 18. The disk 
array chassis includes a diplexer on both ends of the high frequency drive serial busses, 
10 except for the first chassis 1 10 that houses the disk controller 16 where only one diplexer 
is required. Communications can thus be maintained with the preceding and subsequent 
disk array chassis. The environmental monitor communicates with low frequency signals 
.. that can be separated from the high frequency Fibre Channel signals by filtering in the 
diplexer. . The signals from the diplexed cables can be split with one copy of the signals 
1 5 being high pass, filtered while the other copy of the signals is low pass filtered to extract 
each of the two.separate signals: A preferred method of diplexing. hoVvevei-. win be ' 

. -described later herein. 

A data storage systefti is configured by providing 1 or more disk control processors 
- 16. each in communicatipti with one of the Fibre Channel loops arid in low frequency 
20 communication with the environmental monitors. Disk akay chassis are conneCied to the 
. processors in a continuous chain. The arrangement of the high frequency communication 
path with two serial busses through each disk array bhassis providing communications in 
each direction permits, a high frequency loop. Tlie shum in feach disk irray chassis is in 
. the non-bypassed position except for the filial active disk array chassis in the chain which 
25 remains in. the.nonnal .bypass condition closing the loop! the disk conti-ol processors 1 6 
. may be provided, in a fitst chassis 1 10 along with a disk array: This first chassis 1 10 in 
the chain only requires a single diplexer since there is no connection to a preceding 

. chassis. ■ -. ,. . . 

- Dynamically upgrading a data storage system of the invfention" shall now be 
30 described. An existing chain of disk storage chassis is provided.' The System may include 
r.. ■ a single chassis enclosing a disk array with the disk controll6f. Alteriidtively, the system 
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may include additional disk array chassis connected in a chain to the controller chassis. 
The system is upgraded by connecting an additional disk array chassis to the last disk 
array chassis in the existing chain. A communication cable 18 is connected from the new 
disk array chassis to the expansion connector 52 on the chassis of the last disk array 
5 chassis in the existing chain. This last disk array chassis in the chain has a shunt 40 which 
is in the normally bypassed condiUon connecting its first serial bus 22 to the second serial 
bus 24 and completing the Fibre Channel loop. When the cable 18 is inserted into the 
connector, the shunt remains in the bypassed condition. The new disk array chassis is 
now in communication via the low frequency signals conducted over the low frequency 
1 0 serial communication path with the environmental monitor 30. After the connection has 
been made, die environmental monitor 30 in the existing system can communicate with 
the environmental monitor 30 in the new disk array chassis. If it is determined that the 
new disk array chassis is properly connected and operating properly, the shum 40 is 
switched into the non-bypassed state extending the high frequency communications loop 

15 . onto the new chassis. 

Referring now to FIG. 2, a flow chart of the communications conducted aloiig the 
low frequencyenvironmental monitor serial communication pati.. shallnow be described. 

In accordance with the presentiy prefeired embodiment, the commands supported by the 
. . serial protocol along the communication path include a poll, read and write command. 
20 These commands are.issued by 'the disk controlled 16. The poll cdmmaiid returns die 
address of each chassis'and an indication if that enclosure has changed state since the last 
poll was issued. The address of a chassis is known to the environmental monitor 30. At 
present, it is preferred that die address be set by manual switches oh the outside of the 
chassis.. In this manner, a chassis can be given a distinct address different from each of 
25 die oUier chassis that have already been connected to the existing system. Preferably, the 
user will address the chassis in a numerical order sucH as 1 ; 2. 3. 4v... A read commarrd is 
directed to a specific chassis address and returns detailed environmental status about the 
chassis including, its power, cooling and disk drive status. A write command is used by 
ti,e disk controller to control iiie operation of the chassis. This command allows ti»e disk 
30 controller to tun, on or off any port bypass circuit and die shunt 40 of any chassis. . 

With the shunt of iht penultimate"chassis- still in die bypass condition,, the disk • 
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controller is able to monitor and control the newly added last chassis via the diplexed 
serial communication path 42 without disrupung the ongoing activity on the Fibre 
Channel loop. This allows the disk controller to verify the configuration and 
environmental status of the new chassis before enabling the new drives onto the Fibre 

5 Channel loop. As set forth in HG. 2, the disk controller runs a periodic polling 60 of all 
the environmental monitors on the system over the low frequency serial communication 
path 42. The poll command goes out from the disk controller and is received by all of the 
environmental monitors that are connected to the low frequency serial communication 
path. Each environmental monitor 30 on the path returns its address and an indication of 

1 0 whether there has been any state change since the last poll. If a new chassis is detected 62 
durins: this periodic polling process, a dynamic upgrading algorithm is initiated. A time 
delay 64 is impo.scd to allow for the configuration of the system to setde as the new 

cha.ssis is powered up. . 

Alter completion of the time delay, the disk controller reads the status 68 from 
1 5 every environmental monitor 30 along the low frequency serial communication path 42. 
^ The read command produces from each environmental monitor information about the 
■ ciibling and address of the chassis. 70. This is used to verify that the cabling is properly 
• configured. The address is checked to be sure it is within the range of legally assignable 
addresses. The read will also return information as to whether the current chassis- is 
20 operational 72, i.e.. po^yered and functioning properly, a problem is found with.respect 

• to aiiy of the environmental monitors, the Fibre Channel loop will be terminated it the : 

• previous chassis:74, 78 so that only operational chassis are permiited on the Fibre- 
Channel loop., If,the chassis is property connected and dpdratibnal, prricessing continues 

■■ 76 until the new chassis is found 66. If the new enclosure is property connected and is 
25 opemtional, then it wiU be.sei.as the last enclosure in the system 76. The shunt 40 of the 
previous chassis vyUl be switched into a switched state 80 to perinit Fibre Channel 
communicaUons with .the disks on thp new chassis. The Fibre Channel loop may then be 
instructed to either automatically if it is so set or upon manual indication perform a 
discovery process.to. reinitialize the operation on the FiW Channel loop to include the 
30 new disks. This discovery process on the Fibre Channel loop is disruptive to any Fibre 
; Channel activity and may.talce several seconds to complete. TTierefore, it is preferred that 
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the system provide the system administrator with the option of automatically entering 
discovery or selecting a manual process that is initiated by a directive from the host 
system. The discovery process makes the disk drives known to the disk controller's Fibre 
Channel driver and allows the upper layer protocol drivers (SCSI) to communicate with 
5 the disks. 

Advantageously, communications with the new disk array chassis along the high 
frequency Fibre Channel do not begin until the disk controller has had an opportunity to 
communicate with the new disk array chassis through the low frequency communication 
path. This process operates separately and independently through each of the two cables 

10 in a redundant system such as that shown in FIG. 3. Thus, a new disk array chassis in the 
redundant system embodiment is added by connecting two cables to the existing chain, 
one for each loop. The connection of each cable operates separately tp enable 
communications over the respective Fibre Channel loop. FIG. 3 illustrates a chain of disk 
array chassis. At the bottom of the chain, the chassis ! 10 houses a pair of disk controllers 

15 as weii as a disk array. Each disk controller is in connection with one of the Fibre 

Channel loops. The chassis with the disk controller is used for connection to one or more 
host bus adaptors 112. A host bus adaptor links a host computer with the memory storage 
provided by the disk arrays. Each of the disk array chassis 1 0 in the chain, is shown with 
one of two cables connecting each of its redundant loops to the adjoining disk array . 

20 chassis. * ' i . ; \ . , 

* A presently preferred environmental monitor 30 for, use in the invention is shown 
in greater detail ih the block diagram of FIG. 4. The monitor program i$ run on a 
microcomputer 90. The microcomputer is shown connected to the dual UART's 44. One 
'UART is connected to the input end of the chassis, the other, is.connected to the expansion 

25 end. The UART receives and transmits. signals on the, low frequency serial 
communication path 42. - 

The environmental monitor 30 also includes a number of status ports 100 for 
monitoring various conditions within the enclosure. .One of the status signals is the 
chassis address (End Addr); According to the present embodimeni^ the address of the 

30 chassis is manually set by switches on the outside of the chassis. Thus, a chassis can be 
manually set to have an address different from the already present disk array chassis in the 
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existing chain of chassis. Other status signals include power system status, cooling status 
and drive status. The environmental monitor also includes port bypass circuit control 
latches 102. These control the port bypass circuits 26 for each of the disk drives that may 
be inserted into the disk array enclosure. Also one of the latches will coniroJ the shunt 40. 
5 In preferred embodiments of the invention, low frequency signals and high 

frequency signals are frequency division multiplexed into a composite signal for 
transmission on cables between chassis. They may be simply combined and separated by 
a diplex filter at each end of the cable, hence use of the term "diplexing." FlC. 5 shows 
the diplex filter frequency response. FIG. 6 shows a RS-232 type signal, a FC signal, and 
10 the diplexed composite of the two. The diplex filter has three ports, the cable port, a low 
pass port and a high pass port. The filter is consuucied by connecung the output of a high 
pass network and a low pass network together. The high pass network will preferably act 
as an open circuit at low frequency; the simplest form of this high pass network is a 
' capacitor. The low pass network will preferably look like an open circuit to the high 
15 freqiiency Fibre Channel signal; the simplest form of the .low pass network is an.inductor 

or a resistor. "The resistor inay be used if the systeni; can tolerate the DC resistance; 
' altiirnaii'^ely, inductors may be used without loss of effectiveness, but they are not ideal 
devides since Achieving broad bandwidth isolation with,an inductor is more difficult than 
with resistors. ■ . • , , , .. ,. 

20 • ■ • Diplexing may be used for communicauon bet^yeen a variety of types of computer 
components. The connection between these components will preferably be.with a pair of 
twinix cables carrying the two Fibre Channel loops, There is also an RS-232 type 
commuiiicauons channel between environmental monitors. In embpdiments of the 
inveiition, the use of twinax affords two options for coupling the RS-232 type low 
25" frequency Signal ohto the cables. In one embodimem of.the invention, the signal may be 
applied as a differcniial signal on the twinax cable;:in a preferred embodinrtent of the 
invenuon, the signal may be applied as a common mode signal to both sides of the 

twinax. • ' ' ' ■ .. - 

A Circuit for the first iriethod, differential coupling, is shovim in HG. 7. Coupling 
30 the RS-232 type low frequency signal differentially onto the twinax is one possible way to 
pass the signal froih chassis to ch^sis.-This is the same coupling method as.that used for 
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the Fibre Channel signals. This method has the highest level of noise immunity for the 
low frequency signals. Noise sources such as ground noise and low frequency magnetic 
fields can be easily rejected using this technique. On the down side, this coupling method 
will not work if equalized cable assemblies are used (that's not to say that equalization 
5 cannot be done). Another deu-actor is that any residual coupling of the RS-232 type low 
frequency signal into the PC signal will be a differential noise source and cause some 
amount of jitter. 

Regarding ground noise, the chassis to chassis twinax-interconnects will 
preferably be in the range of 0 to 10 meters in length. These connections will be between 
10 chassis within a rack, or between racks in close proximity. There may be a ground voltage 
potential between two systems in different racks. This ground noise is superimposed on 
the cable as a common mode signal. The differential receiver will reject the common 
mode noise, and properly receive the differential signal. 

Regarding magnetic susceptibility, in an embodiment of the invention, the twinax 
15 cable will prelerably be shielded and, in the prefen"ed embodiment of the invention, the 
shield is connected to chassis ground at both ends. Although this configuration is not the 
optimal configuration for magnetic shielding, this is required for good high frequency 
emissions performance. If the cable is brought into an AC magnetic field, a current will be 
•induced to tlow. through the cable shield, around the ground loop, this current will couple 
20 a noise voltage into the internal signals through the niutual inductance between the shield 
, ,and signal conductors. This noise voltage will be coupled in as a common mode noise 
. source in this configuration, and be rejected by the, receiver. 

Regarding coupling noise, in an embodiment of the invention, the Fibre Channel 
, signal is very low amplitude relative to the RS-232 type low frequency signal. With the 
25 / use of a simple R/C pulse shaping filter, and simple capacitive/resistive diplex filter, there 
is some residual RS-232 signal coupled into the Fibre Channel receiver as shown in FIG. 
5. This noise is minimized, bjf niaking the slew rate of the RS-232 type low frequency 
signal as slow as possible for the required data rate. The residual noise coupled into the 
PC receiver is differential noise in this instance, and results in some additive jitter on the 
30 received PC signal. This noise is manageable fpr data rates of 9600 baud and below, while 
better lowpass filtering may be required' for higher data rates. : 
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Regarding external compatibility, in an embodiment of the invention, the rejection 
of the low frequency signal in the Fibre Channel receiver is accomplished by the AC 
coupling circuit at the receiver front end. This coupUng circuit uses 1000 pF capacitor and 
150 ohm termination resistance. If a cable carrying a diplexed signal is plugged into 

5 another vendor's equipment, the residual signal coupling, described further below, may be 
quite severe. The critical factor is the value of the coupling capacitance, as larger values 
increase the unwanted signal coupling. As there is no standard for this circuit, a preferred 
embodiment will allow for blocking the diplex signal when connecting to an external host 
device that cannot safely support the present invention. Preferably, a media converter will 

10 be designed to overcome such connection problems. Note, however, that this only applies 
to JBOD configurations ("just a bunch of disks," i.e. no controller for the disks within the 
JBOD unit) with DB-9 twinax cables. 

Regarding equahzer compatibility, in an embodiment of the invention, the low 
frequency signal is coupled onto the'twinax cable with Ik ohm resistors instead of 

15 inductors. This places a high DC resisunce in series with the RS^232 type low frequency 
driver. An equalizer, which would'be used for a long twihax cable, will have a fairly low. 
impedance between the differenual signals. There will be a voltage divider effect between 
the equalizer impedance and the coupling' resistors which will severely attenuate the low 
frequency signal This will be a problem if an equalized cable assembly is used. A ^ 

20 preferred solution to this issue is to use equalizers for the DB-9 twinax cable, and tapping 
off the low frequency signal before the equalizer. This would allow the DB-9 to DB-9 
media converter to contain an equalizer* if we want to support twinax links over 10 meters 
long. Preferred embodiments will not operate with twinax cables which have an equalizer 
in the cable connector housing. 

25 Regarding crosstalk, in an embodiment bf the invemion, the invention will utilize 

twinax having four conductors contained within a'common shield (hereinafter twinax4)', 
wherein isolauon. between the two conductor pairs is maintained by locating the two pairs 
orthogonally in the cable. This insures symmetricai coupUng 'from the + and - differential 
signals, and the net differential crosstaDc between pairs is 0. One pair carries the outgoing 

30 signals and the other pin carries the returning' signals. 'For differential coupling of the RS- 
232 type low frequency signal/ihere will'not be any stibstaintial crosstalk coupling from 
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one pair to the other. 

A circuit for the second method, common mode coupling, is shown in FIG. 8. 
Preferred embodiments of the invention utilize the fact that the Fibre Channel receiver has 
common mode rejection to reduce noise coupling from the low frequency signals. 
5 Consequently, since the two signaling approaches on the cable are orthogonal, allowing 
each receiver to reject the signal from the other. The high frequency signal will preferably 
be driven differentially on the twinax pair, and the low frequency signal will preferably be 
driven on both signal conductors with the cable shield serving as the signal return path. 
The advantages of this method are that it allows potentially higher signaling rates, is 
10 compatible with equalized cable assemblies, and is potentially more compatible with host 
interfaces. The noise rejection and crosstalk performance are worse however. 

Regarding ground noise issues, in an embodiment of the invention, any ground 
potential difference between the transmitter and receiver ends of the cables will couple 
directly into the common mode low frequency signal as noise. While this is not a new 
15 problem for RS-232 type links, it is often overcome by running very large signal swings. 
A preferred embodiment of the invention would be to keep the swing at 5V peak to peak, 
or less, which may not be as immune to this noise as traditional links. 

Regarding magnetic, susceptibility, in an embodiment of the invention, by running 
the low frequency signal as a common mode signal, the twinax is being used essentially as 
20 a coaxial cable. This type of cable configuration allows the shield current induced by an 
AC magnetic field to irnpose a noise voltage onto the low frequency signal, this voltage 
will detract from the signal's noise margin, . 

Regarding coupling noise, in an embodiment of the invention, coupling of the 
RS-232 type low frequency signal into the Fibre Channel receiver is now less of a 
25. problem because.the residual s;gnal coupling is being applieid as a common mode noise 
source. The receiver has very good rejection to low trequency common mode noise, so the 
noise does not create any jitter on the Fibre Channel signal. This allows the low frequency 
signal pulse filiering to be relaxed, and higher data rates can be accommodated. 

: The Fibre Channel, receiver has a limited common mode rejection range, so the 
30 common mode signal must be attenuated before it reaches the receiver, this attenuation is 
achieved by a voltage divider effect between the Fibre Channel coupling capacitors, and 
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the 150 ohm lerminauon impedance. Preferred embodiments will have termination mode 
up of two 75 ohm resistors to VBB or some other DC source to provide a common mode 
termination. 

Regarding external compatibility, in an embodiment of the invention, the 
5 attenuation of the common mode low frequency signal in the Fibre Channel receiver is 
accomplished by the AC coupling circuit and termination at the receiver front end. The 
value of the coupling capacitor is less critical in this configuration, as any additional noise 
will be rejected. The critical factor for interoperability is that the termination be common 
mode. As there is no standard for this circuit, a preferred embodiment will allow for 
10 blocking the diplex signal when connecung to an external host device that cannot safely 
support the present invenUon. Preferably, a media converter will be designed to overcome 
such connection problems. Note, however, that this only applies to JBOD configurations 
with DB-9 twinax cables. 

Regarding equalizer compatibility, in ah' embodiment of the invention, the 
1 5 common mode transmission of'the low frequency signal is fully compatible with 

equalized cable assemblies, the equalizer will kct as a low impedance in series with the 
signal path which will have a minimal effect. 

Regarding crosstalk, the common mode low frequency signal does hiave a crosstalk 
issue on the twinax4. The cable has capacitive coupling between the two signal pairs 
20 which induces a noise voltage on the other low frequency signal in the cable: This • • 
coupling is dependent on risetime, and is sensitive to cable length. In preferred 
embodiments of the invention, overall the crosstalk will only be a few percent; and will 
not significantly degrade the noise margin of the signal. 

^ FIG. 9 is a simplified diagram of an enibodiment of ihe diplexing of the invention, 
25 wherein first and second signals'aJ-e transmitted on a communication Unk*, and wherein the 
communication link is preferably twin-ax or twi'sie'd'pair table having a transmission-end 
and a receiving-erid. The com municatioii link has a paif of conductors including a first 
conductive path and a second conductive path. The first signal to be transmitted is 
designated as signal (A), and the second signal' is de'si^gnated as signal (B). Signal (A) is 
30 sent as a differential mode signal. Signal (B) is sent as a common mode signal. The first 
conductive path contair^s the addition of signals (A) + (B). The second conductive path ' 
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coniains the subtraction of (B) - (A). At the receiving-end, the first and second conductive 
paths are both sent separately lo an adder and a subtracter. At the subtracter, the second 
conductive path's signal (B)-(A) is subtracted from the first conductive path's signal 
(B)+(A), resulting in the (A) signal. At the adder, the second conductive path's signal (B)- 
5 (A) is added to the first conductive path's signal (B)+(A), resulting in the (B) signal. A 
useful consequence of this embodiment of the invention is that in the subtracter, common 
mode line noise is efficiently eliminated, and in the adder, differential mode line noise is 
also eliminated. 

FIG. 10 is a particular implementation of the FIG. 9 embodiment, using 
U) transformers. 

Referring now to FIGS. 1 1-13, the common mode coupling embodiment of a 
diplexer 50 is shown in greater detail. The RS-232 type low frequency signal output is 
provided to an inverter with hysteresis input 120. The signal is then passed through a low 
pass filter 1 22. The low pass filtered signal is then common mode coupled onto the 

1 5 twinax cable. The retum signals are summed at a node 1 24 where both returning signals 
are connected. The summed signal is low pass filtered by capacitors 126 connected to 
ground. The summed and filtered signal is provided to a receiver 128 which in the 
presently preferred embodiment is an LM 393 dual comparator. 

Referring to FIG. 1 3, the expansion connector 52 is shown. A DB9 connector is 

20 the presently preferred cable connector 52. Signals received on the connector are passed 
through an equalizer 130. The received signals are then passed to the low frequency input 
portion of FIG. 1 1 and the high frequency input portion of FIG. 12 which will now be 
described- The high frequency input portion passes the received signals through a high 
pass filter 132. A port bypass circuit 134 then acts as a differential receiver. The 

25 differential receiver acts as a subtracter looking at the difference between the received 
signals. The resulting high frequency signals are passed through the port bypass circuit 
134 to the shunt 40 and to a signal detector 142. The output of the signal detector 142 
may be used to allow the shunt 40 to remain in its normal state when no signals are 
detected. When a signal is detected the shunt 40 may assume its switched state if 

30 authorized by the environmental monitor. 

The received signals that are passed through the shunt 40 continue onto the serial 
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bus 24 represented by the FC-SHUNT signals. Outgoing high frequency fibre channel 
signals are provided by serial bus 22 represented by the FC-LOOP signals. The outgoing 
signals are driven through the shunt 40. Depending upon the state of the shunt 40, these 
signals v^ill either loop back to the serial bus 24 on the FC-SHUNT lines or proceed 
towards the cable connector 52. The signals sent lo the cable connector 52 are 
differentially driven by shunt 40. One signal is inverted and the other noninverted. The 
inverted and noninverted signals are passed through a high pass filter 138. Thereafter, the 
fibre channel signals are combined with the low frequency signals from the low frequency 
output portion of the diplexer to produce a sum of the high and low frequency signals and 
a difference between the low and high frequency signals. The sum and difference signals 
may ihen.be passed through an equalizer 140 before they reach the cable connector 52. 
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WE CLAIM: 

1. A dynamically upgradeable disk array chassis comprising: 
a chassis; 

a plurality of ports within said chassis that make connection with a plurality of 
5 data storage devices; 

serial bus means for interconnecting said plurality of data storage devices, said bus 
means including a first bus for passing data in one direction and a second bus for passing 
data in a second direction; 

a shunt connected to the first bus and the second bus and having a normal state in 
1 0 which the first bus is connected to the second bus across said shunt and a switched state in 
which each of the first bus and the second bus is connected to a separate output; 

an environmental monitor connected to said shunt to control the state of said 

shunt; 

a communication path connected to said monitor; 

15 connection means, on the chassis coupled to said communication path and to said 

shunt, for making data communication connection with a communication path and a serial 
bus from a new disk array chassis, wherein said environmental monitor communicates 
through said communication path with the new disk array chassis before switching said 
shunt to the switched state to connect said serial bus means with the serial bus on the new 

20 disk array chassis. . . 

2. The disk array chassis of claim 1 further comprising a second serial bus 
means, a second environmental monitor, a second shunt, a second communication path 
and a second connection means so as to provide a redundant communication path with the 

25 plurality of storage devices. 

3. The disk, array chassis of claim 1 wherein said serial bus means carries high 
frequency data signals and said communication path carries low frequency data signals. 

30 4. ..-The disk array chassis of claim 3 further comprising a diplexer, connected 

between said connection means and both said shunt and said communication path, for 
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adding the high frequency data signal to the low frequency data signal to produce a sum 
signal and for subuaciing the high frequency data signal from the low frequency data 
signal to produce a difference signal. 

5 5. The disk array chassis of claim 3 further comprising a diplexer connected 

to said connection means for receiving a sum signal and a difference signal from the new 
disk array chassis and including an adder and a subtracter for extracting a high frequency, 
data signal and a low frequency data signal from the new disk array chassis. 

I Q 6. The disk array chassis of claim 3 wherein said connection means comprises 

a twinax cable connector. 

7. The disk array chassis of claim 6 further comprising a diplexer connected 
to said shuni and said communication path to provide a combination of the high frequency 

15 data signals to said twinax cable connector. 

8. A dynamically upgradeable disk array chassis comprising: 

■ ' ' ' . .... ' * ) . 

a chassis; 

a plurality of ports within said chi^sis that make connection with a plurality of 

20 data storage devices; 

serial bus means, interconnecting said plurality of data storage devices, for 

carrying high frequency data signals; 

an environmental monitor connected to said plurality of data storage devices to 
detect status of a plurality of conditions within said 'disk array chasses; 
25 a communicauon path connected to said moni'tor for canying low frequency data 

signals; 

a connector accessible outside said chassis to allow communication therethrough 
with a low frequency communication path and a high frequency serial bus from a new 
disk array chassis; 

30 a shunt, connected to said serial bus means and having a normal state in which 

said serial bus means is disconnected from said connector and a switched state in which 
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said serial bus means is in communication, through said connector, with the high 
frequency serial bus from the new disk array chassis; and 

wherein said environmental monitor communicates by low frequency signals 
through said communication path with the new disk array chassis and afterwards causes 
5 said shunt to switch to the switched state. 



9. The disk array chassis of claim 8 further comprising a diplexer connected 
to said communication path and to said shunt for combining high frequency data signals 
and low frequency data signals in one direction and for separating high frequency data 

10 signals from low frequency data signals in a second direction. 

10. The disk array chassis of claim 9 wherein said diplexer combines by 
adding the high frequency data signals to the low frequency data signals to produce a sum 
signal and by subtracting the high frequency data signals from the low frequency data 

15 signals to produce a difference signal. 

1 1 . The disk array chassis of claim 9 wherein said diplexer includes an adder 
<ind a subtractor for separating the high frequency data signals from the low frequency 
data signals in the second direction. 

20 , . . ' ' ^ ' 

12. The disk array chassis of claim 8 further comprising a second serial bus 
means, a second environmental monitor, a second shunt, a second communication path 
and a second connector so as to provide a redundant communication path with the 
plurality of storage devices. 

25 V ' . 

13. The disk array chassis of claim 8 wherein said connector is a twinax cable 
connector and wherein the high frequency data signals and the low frequency data signals 
travel through said connector when said shunt is in the switched state. 

30 14. A dynamically upgradeable disk array chassis comprising: 

a chassis; 
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a plurality of pons within said chassis that make connection with a plurality of 

data storage devices; 

serial bus means for interconnecting said plurality of data storage devices, said 
serial bus means including a first bus for carrying high frequency data signals in one 
5 direction and a second bus for carrying the high frequency data signals in a second 
direction; 

a shunt connected to the first bus and the second bus and having a normal bypass 
state in which the first bus is connected to the second bus across said shunt and a switched 
state in which each of the first bus and the second bus is connected to a separate output; 
10 an environmental monitor connected to said shunt to conu-ol the state of said 

shunt; 

a communication path connected to said monitor for carrying low frequency data 
signals; 

a diplcxcr connected to said communication path and to the separate outputs of 
1 5 said shunt for combining the high frequency data signals and the low frequency data 
signals in the one direction and for separaung a high frequency data'signal from a low 
frequency data signal in the second direction; and 

a.conncctor, connected to said diplexer, accessible outside said chassis to make 
data communication connection with a low frequency conimunication path and a high 
20 frequency serial bus from a new disk array chassis, wherein said environmental monitor 
communicates with low frequency signals through said communication path with the new 

disk array chassis before switching said shunt to the switched state to connect said serial 

■ - ' • - ' - i. . . :■ 

bus means to the high frequency serial bus on the new disk array chassis. 

' - . - " ' ..').. , 

25 1 5. The disk array chassis of claim 14 wherein said diplexer combines by 

adding the high frequen9y data signals to the low frequency data signals to produce a sum 
signal and by subuacung the high frequency data signals from the low frequency data 
signals to produce a difference signal. 

30 
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1 6, The disk array chassis of claim 14 wherein said diplexer includes an adder 
and a subtractor for separating the high frequency data signals from the low frequency 
data signals in the second direction. 

5 17. The disk array chassis of claim 14 further comprising a second serial bus 

means, a second environmental monitor, a second shunt, a second communication path, a 
second diplexer and a second connector so as to provide a redundant communication path 
with the plurality of storage devices. 

18. The disk array chassis of claim 14 wherein said connector is a twinax 
cable connector and wherein the high frequency data signals and the low frequency data 
signals travel through said connector when said shunt is in the switched state. 

• 19. A method for dynamically upgrading a data storage system comprising: 

1 5 > providing a disk array chassis having a plurality of data storage devices 

interconnected by a high. frequency data bus, an environmental monitor coiinected to a- - 

low frequency communication serial and a diplexer for combining high frequency signals. 

from the high frequency data path with Jo w frequency signals from the low frequency ' 

communication path; ; o ; ' 

20 . connecting a, cable between the diplexer of said disk array chassis and a ponnector 

on said data storage system; . . ' , 

conrimunicating with said disk array chassis v/itti low frequency signals through 

said cable arid said cdmmunicatibn bus; and 

switching a shunt in the data storage system to permit high freqiiency signals to 
25 communicate between said data storage system and said disk array chassis. 

49122 
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